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Abstract 

In cases where the same real-world system can be modeled both 
by an ODE system D and a Boolean system B it is of interest to 
identify conditions under which the two systems will be consistent, 
that is, will make qualitatively equivalent predictions. In this note we 
introduce two broad classes of relatively simple models that provide a 
convenient framework for studying such questions. In contrast to the 
widely known class of Glass networks, the right-hand sides of our ODEs 
are Lipschitz-continuous. We prove that under suitable assumptions 
about B consistency between D and B will be implied by sufficient 
separation of time scales in one class of our models while it may fail in 
the other class. These results appear to point to more general structure 
properties that favor consistency between ODE and Boolean models. 

1 Introduction 

The dynamics of many real-world, in particular biological, systems exhibits 
switchlike behavior. Examples include gene regulatory networks, where at 
any given time a gene may be expressed (switched on) or not expressed 
(switched off) and neuronal networks, where at any given time a neuron 
may or may not fire. Mathematical models of such systems can often take 
the form of a differentiable flow D or a Boolean dynamical system B. The 
former type of model usually incorporates more relevant details and appears 
biologically more realistic, while the latter type may be easier to analyze, at 

'Corresponding author. Department of Mathematics, Ohio University, Athens, OH 
45701, U.S.A. E-mail: mathjust@gmail.com 

f T.Y. and this work were partially supported by the NIH-NIGMS grant R01GM090207. 



least by simulations. The literature describes a vast number of cases where 
Boolean and other discrete models have been successfully used to make 
realistic predictions about real-world systems; for example, several chapters 
of [16] review such success stories in biology. 

If the same real-world system can be modeled both as a differentiable 
flow D and a Boolean system B, the question naturally arises how the two 
models are related to each other. This question has several distinct aspects, 
two of which will be discussed in this note: translation between the two 
types of systems and consistency. 

1.1 Translation between flows and Boolean systems 

Differentiable flows D are induced by ODEs 



While formally different mathematical objects, for convenience we will 
sometimes refer to the flow D and the ODE ([I]) as if they were synonymous. 
The state space of a differentiable flow is a subset M of some R , typically 
a compact manifold. 

The state space of an n-dimensional Boolean system is the set {0, l} n 
of n-dimensional Boolean vectors s. The dynamics is given by a Boolean 
function / : {0, l} n -»• {0, l} n so that 



While a Boolean system is formally a pair IB = ({0, l} n ,/), the state 
space is already implied by the updating function / as its domain, so we 
will sometimes use / itself as shorthand for specifying B. 

Translating a flow D into a Boolean system B requires at the minimum 
construction of a map S : M — > {0, l} n that we will call the discretization 
of M . Typically, this map is constructed by discretizing the values Xi for n 
among the variables in M and assigning to them the Boolean value Si = if 
Xi is below a threshold Oj and Sj = 1 if Xi is above this threshold. In practical 
applications it may be far from obvious how to choose the thresholds Oj, 
see [33], but this issue is beyond the scope of this note. We want to point 
out though that not all variables in M need to be discretized. For example, 
in models of gene regulation one may choose to incorporate only discretized 
values of mRNA concentrations but not of their translated proteins into the 
Boolean model. Similarly, the Boolean models constructed in [17] have only 
one Boolean variable per neuron, while the state of each each neuron in 



x = g(x). 



(1) 



s(r + l) = f(s(r)). 



(2) 
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the ODE model is characterized both by the cross-membrane voltage and a 
second, so-called gating variable. 

Translating the ODEs (JIJ into a Boolean updating function / is less 
straightforward than discretizing some variables, except in special cases 
when we have strong consistency (see Section [3]) , or when / itself is inherent 
in the construction of D. In practice, the updating functions of Boolean 
models are usually based directly on the available empirical knowledge of 
the real-world system. Fortunately, for the results reported here, it does not 
matter how / is constructed. Therefore we will here somewhat informally 
assume that a given flow O has been translated into a Boolean system B 
by means of a discretization S and some unspecified "natural" choice of / 
and call the resulting IB a (natural) Boolean approximation o/D. We need 
to emphasize though that our usage of these phrases does not imply any 
consistency whatsoever between a given flow and its natural Boolean ap- 
proximation. 

Wile at least some differentiable flows D have unique natural Boolean 
approximations, translation from Boolean into ODE systems cannot be a 
one-to-one procedure. However, for some types of real-world systems we 
may have a fairly good idea about a general class of ODE models that give 
a reasonably good description of the underlying mechanisms. Being able 
to identify a subset or a single representative of this class that will have 
a given Boolean system as its approximation can be a powerful tool for 
model selection in cases where the available data allow for construction of 
Boolean models. The caveats about non-uniqueness nonwithstanding, we 
like to think about this process as translating Boolean into ODE models. 

For example, Glass networks are an extensively studied class of simple 
ODE models for gene regulatory networks [2], [5]-[8]. In these networks, the 
concentration X{ of the i-th mRNA (or gene product, if one prefers to think 
about them this way) is modeled by a DE 



where Fi is a piecewise constant (usually discontinuous) production term 
and — XiXi is the decay term. Under certain technical assumptions a Glass 
network has a natural Boolean approximation. 

Similarly, Terman et al. |T7j constructed a class of excitatory-inhibitory 
neuronal networks whose ODE models have natural Boolean approximations 
and showed that every Boolean system can be translated into a model in 
this class. Together with the theorem about consistency that was proved 
in [T7], this makes both the continuous and discrete dynamical systems 




(3) 
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promising candidates for modeling actual neuronal networks that exhibit a 
phenomenon called dynamic clustering. As in Glass networks, some ODEs 
of [T7j have right-hand sides with discontinuities. 

Here we introduce two other classes of differentiable flows with natural 
Boolean approximations so that every Boolean system can be translated 
into a set of flows in each class. These classes are very broad, relatively easy 
to study, and the ODEs in our classes have Lipschitz-continuous right-hand 
sides. While these classes are not directly related to any applications that 
we are aware of, we believe they provide a convenient set of toy models 
for exploring the relation between differentiable flows and their Boolean 
approximations, such as conditions for consistency. In particular, the study 
of these classes may allow us to identify which type results about Glass 
networks or from [17] do require discontinuities in the right-hand sides of 
the ODEs, such as in ([3]), and which ones do not. 

1.2 Consistency 

If a flow D and a Boolean system IB are to function as useful models of 
the same real-world system, they should be consistent in the sense that 
they make equivalent predictions. In particular, we would like to assure 
that for all trajectories of D that start in a sufficiently large subset U of M 
the next Boolean state of the system will be what /, or at least one of the 
coordinates of /, predicts for the current Boolean state S(x(t)). While quite 
intuitive, this notion is not easy to formalize; in fact, it admits a number 
of nonequivalent formal definitions that seem plausible. The choice of the 
most appropriate one may depend on the context (see Section [7] for a brief 
discussion of one example). The problem is that while each state s(r) of B 
has a well-defined successor state s(r + 1) = /(s(r)), time in the flow D 
increases continuously and one has to pick a time t + > t for which S(x(t + )) 
will be considered the "next" Boolean state after time t. Here we will study 
two such formal and quite natural notions; we call them strong consistency 
and consistency. 

1.3 Outline of the paper and main results 

In Section [2] we will describe methods for translating, in the sense of Subsec- 
tion [lTJ a Boolean system B = ({0, l} n , /) into differentiable flows 7) 
and D2(/)7) with state spaces I n and I 2n respectively, where I will be a 
certain compact interval. Each real variable in systems Bi(/, 7) will corre- 
spond to a separate Boolean variable; while for systems 02(7,7) only the 
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variables Xi for i G {l,...,n} will have Boolean discretizations. We call 
these variables the signature variables as they determine the Boolean state 
of the flow. Each signature variable Xi receives input only from whereas 
Xi +ri receives input only from the signature variables xi,...,x n . 

One can think about the systems D2(/j7) as describing the dynamics 
of agents Xi = {xj,Xj + i} whose internal states are represented by the XjS 
and who receive signals about the state of the system as a whole through 
Xi+ n . Thus we will refer to the variables xi-\. n as the signaling variables. The 
parameter 7 will allow us to control the degree of separation of time scales 
between variables of the flows; in particular, between the dynamics of the 
signature variables and the signaling variables. Let us mention that Di (/, 7) 
and B2(/, 7) also depend on another parameter Q that can be thought of as 
the particular translation method or conversion scheme. Most of our results 
allow a lot of flexibility in the choice of Q but assume Q fixed; therefore we 
will often suppress this parameter in our notation. 

In Section [3] we formally define the notions of strong consistency and 
consistency. In Section|4]we define the two important classes of one-stepping 
and monotone-stepping Boolean systems and show that strong consistency 
is possible only if the Boolean system is one-stepping. In Section [5] we 
give some examples of (strong) consistency or lack thereof for very simple 
Boolean systems. In Section [6] we prove the two main results of this paper, 
namely that sufficient separation of time scales guarantees strong consistency 
of 02(/> 7) with / for one-stepping / and consistency of ID>2(/, 7) with / for 
monotone-stepping /. In Section [7] we discuss the relation of our results 
to similar work in the literature and we outline some directions of future 
research. 

1.4 Notation 

Our mathematical notation is mostly standard. The set {1, . . . ,n} will be 
denoted by [n]. The cardinality of a set X will be denoted by \X\. Time 
in flows will be denoted by t. Since most Boolean systems are not time- 
reversible, we will only be interested in forward trajectories of the corre- 
sponding flows and will always assume that t G [0,oo). States in flows will 
be denoted by x, with x(t) denoting the state at time t of the trajectory with 
initial state x(0). Time in Boolean systems will be denoted by r and will be 
assumed to be a nonnegative integer. The components of a real-valued vec- 
tor x will be denoted by X\\ similarly, the components of a Boolean vector s 
will be denoted by Sj. Trajectories in a Boolean system B = ({0,1}™,/) 
are sequences {s(r)}^ =0 such that s(r) = f T (s(0)) for all r. The Hamming 
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distance H(s,s*) between two Boolean vectors is the number of indices i 
such that Si / s* . 

2 The flows Di(/,7) and D 2 (/,7) 
2.1 General definition 

Fix n and let s £ {0, l} n . Let N > n and define sets Wf C 1^ for i £ [n] 
as follows: 

Wf = {x : Xi < -1} if Si = 0, Wf = {x: Xi > 1} if ai = 1. (4) 
Let W s = r\iein]Wl- 

A continuous conversion of a Boolean updating function / : {0, l} ra — > 
{0, l} n is a continuous function 

Q = (Qi,..-,Qn):M Ar ^[0,l]" 

such that 

Vs e {0, l}"Vf G Vi G [n] Q<(f) = /i(a), (5) 

where /j is the i-th component of / = (/i, . . . , / n ). For example, the piece- 
wise linear function 



L(x) 



ifx<-l, 

.5(s + l) if - 1< x < 1, (6) 

1 ifx>l, 



allows us to construct continuous conversions L(xi) for the projections 7Tj(s) = 
Si and L n := (L(xi), . . . , L(x n )) of the identity function fid(s) = s. 

A conversion scheme is a map Q that assigns to each Boolean function 
a continuous conversion Q(f). 

Now let Q be a conversion scheme, let / : {0, l} n — > {0, l} n be a Boolean 
function, and let 7 be an n-dimensional vector of positive reals. Define an 
ODE systems B>i(/, 7, Q) (or simply Di(/, 7) if Q is assumed fixed or implied 
by the context) by 

Xi = li{g{xi) + GQi(x)), (7) 

where 



6 



g(x) = 3x — x 3 — 3 



(8) 



and Qi is the i-th coordinate of Q = Q(f). 

While we assume here for simplicity that the parameters ji are constants, 
we want to remark that the arguments in this paper can be generalized to 
the case when these values are allowed to depend on the state or even change 
over time in a nonautonoumous way, as long as they are all bounded and 
bounded away from zero, that is, if there are constants M > m > such 
that m < 7i(x, t) < M for all i, x. 

In order to see how the systems 7) behave, consider the family of 

flows generated by the one-dimensional ODEs 



where we consider both 7 and h as potential bifurcation parameters. 

The only bifurcations with respect to 7 occur at the bifurcation value 7* = 
0. These will be of no interest to us, since we will assume that 7 > 0. Under 
this assumption 7 does not alter the qualitative behavior of Q but controls 
the speed at which trajectories are being traversed, with small 7 correspond- 
ing to slow change. Thus suitable choices of 7 will allow us to study the 
effect of separation of time scales. 

Next note that g has two local extrema, a local minimum g{— 1) = —5 
and a local maximum g(l) = —1. Thus for 7 > the family of flows 
defined by Q undergoes two saddle-node bifurcations with respect to h: For 
h < h* = 1, there will be exactly one globally stable equilibrium x* < — 1; for 
1 = h* < h < h** = 5 there will be two locally stable equilibria x* < — 1 and 
x** > 1 as well as one unstable equilibrium x° G (0, 1); and for h > h** = 5, 
there will be exactly one globally stable equilibrium x** > 1. This translates 
into the context of ([7]) as follows. 

Proposition 1 Assume Qi is a constant. If Qi < 1/6, then ^ will have 
exactly one globally asymptotically stable equilibrium x* < — 1; if 1/6 < Qi < 
5/6 there will be two locally stable equilibria x* < — 1 and x** > 1 as well as 
one unstable equilibrium x° G (0,1); and if Qi > 5/6, there will be exactly 
one globally asymptotically stable equilibrium x** > 1. 

Of course in our actual systems 7) and ©2(7, 7) the values of Qi will 
change along trajectories; much of our work in this note will be concerned 
with studying the consequences of such changes. 



x = j(g(x) + h) 



(9) 
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For Q, f as above and a 2n-dimensional vector 7 of positive reals, we 
define an ODE systems ID>2(/, 7, Q) (or simply ©2(7, 7) if Q is assumed fixed 
or implied by the context) with variables Xi,Xi +n for i £ [n] by 



= li{g{xi) + 6L(x i+n )), ^ 

Xi+n = 7i+n(fl , ( 2; j+n) + 6Qi{xi, ■ ■ ■ , X n )), 

where Qi is the i-th coordinate of Q = Q(f) and L,g are as in ([6]), ([8]). 

In a sense, equations ( flO| ) are special cases of equations ([7]). To see this, 
let / = (/i,/ 2 ,..-,/n) : {0, l} n -> {0,l} n be given. For each i G [n] we 
define an auxiliary function Cj(s) = s n +j that copies the value of variable 
number n + i to variable number i. Extend / to a Boolean function / + : 
{0, l} 2n {0, l} 2n given by 

/+ = ( C ,/) = (ci,...,c n , /!,...,/„). (11) 
Then assmning a conversion scheme Q with Q{j^i-\-n) — ^{•^i-\-n 

) the sys- 
tem (10) is the same as the system @ that defines Di(/ + ,7, Q). 



Since L and Qi take only values in the interval [0, 1], we make the fol- 
lowing observation (see [11] for a proof). 

Proposition 2 Let f be an n- dimensional Boolean function and let 7 de- 
note any vector of positive reals of suitable dimension. Let x~ ~ —2.1038 
be the unique root of the polynomial g(x) = 3x — x 3 — 3 and let x + 2.1038 
be the unique root of the polynomial g(x) + 6 = 3x — x 3 + 3. Then [x~ , x + \ n 
is a forward-invariant set in 7) and [x~,x + ] 2n is a forward-invariant 
set in O2 (/, 7). 

Thus for our purposes we will consider M = [x~ , x + ] n as the state space 
of the flow Di(/, 7) and M = [x~,x + ] 2n as the state space of the flow 
^(/jT*)- We define discretizations of individual variables in these flows by 

ifliS °' (12) 
I 1 if Xi > 0, 

and define S : M -> {0, l} n as 

S(x) = J] Si(x). (13) 

ie[n] 

In particular, S maps each of the sets W s to s. 
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Note that even though the systems D2(/>7) have dimension 2n, both in 
the case of E3>i(/, 7) and of K)>2(/> 7) the Boolean state S(x) depends only on 
the variables x\, . . . ,x n . Let us call these variables the signature variables 



of the ODE system. According to (10), in the systems D2(/, 7) none of 



these signature variables is directly influenced by signature variables; all 
interactions are mediated by the variables . . . , %2 n - Therefore we will 

refer here to the variables x n +i, . . . , X2n as the signaling variables. 

2.2 Examples of conversion schemes 

Here we give examples of several specific conversion schemes Q. All of them 
represent the functions Qi as compositions 

Qi(x) = Pi(L{xi),...,L{x n )), (14) 

where Pj : [0, l] n — > [0, 1] is a continuous function. Such P = (Pi, . . . , P n ) 
will result in a continuous conversion Q of a Boolean function / : {0, l} n — > 
{0, l} n that satisfies ^ as long as 

Vs G {0, l} n Vi G [n] P(s) = /i(S). (15) 
Wittman et al. [18| give an algorithm for constructing polynomial func- 



tions of minimal possible degree that satisfy ( 15 ) and prove their uniqueness. 



Together with (14) these minimal-degree polynomials define a conversion 
scheme Qw- 

While polynomial functions of minimal degree have desirable properties 



from our point of view (see Subsection 5.1 ) and may be in some ways optimal, 



we want to allow also for other possible conversion procedures. 

A drawback of Qw is that the algorithm of [TH] requires evaluation 
of fi(s) at 2 n data points, even if /j is given by a very simple Boolean 
formula. But for simple /j it may be much easier to construct a suitable 



polynomial Pj. For example, the following choices of Pj satisfy (15): 

• If fi = Sj A s k , let Pi = XjX k . 

• If fi = — iSj , let Pi = 1 — Xj. 

• If fi = sj V let Pi = xj + x k - XjX k - 

• If fi = Sj © Sk, where © denotes exclusive or, let Pj = Xj +x k — 2xjX k - 
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If fi is given in conjunctive or disjunctive normal form, then one can use 
the first three observations above to recursively construct Pi, which in con- 



junction with (14) defines recursive conversion schemes Qr c , Q,Rd- Similarly, 
since the operation © is the same as addition in the field F2, the first and 
fourth of the above observations can be used to define a recursive conversion 
schemes Qrf for Boolean functions that are given as polynomials over the 
field F2 in the form 

Ms) = n Sj © n Sj © • • ■ © n Sj , ue) 

jeJi 3&J2 jeJk 

where J\, J2, ■ ■ ■ , Jk are subsets of [n]. 

In all three cases, if the relevant expressions for fi contain few terms, 
these recursive conversion schemes allow for faster computation of polyno- 
mials Pi than the algorithm of |18| for Qw, but are not guaranteed to return 
polynomials of minimal degree. 



Suppose fi is given as a polynomial over F2 as in (16). If A; is relatively 
large, then using the recursive conversion method Qrf becomes unwieldy. 
However, one can find a quick and easy conversion as follows. First re- 



place ( 16 ) with a polynomial function u : W 1 — > IR defined by 



jeJi 3&J2 j&Jk 



Then define 



Pi(x) = 0.5 - 0.5cos(ttu(x)). (18) 
The resulting function Pi is no longer a polynomial, but it is continuous, 



even analytic, and maps [0, l] n into [0, 1]. According to (16), for s £ {0, 1}" 
the value fi(s) is if an even number of the products IljeJ^ s i evaluates 
to 1 and is 1 if an odd number of the products Iljej^, s j evaluates to 1. In 
other words, fi(S(x)) = if u(x) is an even integer and fi(S(x)) = 1 if u{x) 



is an odd integer. Now follows from (18). 

This defines yet another conversion scheme Q a ; we call it arithmetic 
conversion. It has the advantage of allowing very fast computation of the 
conversion for Boolean functions that are represented as polynomials over F2 . 
A potential disadvantage is that Pi will in general take the values and 1 
at many points in the interior of [0, l] n , which may introduce additional 
equilibria of 7, Q a ) or D2(/j 7, Qa) that have no counterparts in terms 

of /. While we have not studied in detail whether these equilibria may 
adversely affect consistency in some cases, the results of Section [6] show that 
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they do not destroy consistency in B>2(/>7>Sa) under the assumption of 
sufficient separation of time scales. 

Finally, we want to point out that for all conversion schemes described 
here the right-hand sides of the ODEs (J71) and ( 10 ) will be Lipschitz-continuous. 



2.3 Software for conversion and exploration 

We wrote a software package Boolean- Continuous GUI that runs under Mat- 
Lab and is capable of constructing, for user-specified / and 7, ODE sys- 
tems Di(/, 7, Q) and 1D>2(/i7) Q), where Q G {Qrf, Qa}- The software also 
allows for simulating trajectories in these flows, tracking the corresponding 
Boolean states, and detecting certain additional features. Both the software 
and its user-manual are available from the authors upon request. 



3 Consistency and Strong Consistency: Definitions 

Suppose D is a flow on a forward-invariant set M C R N , let B = ({0, l} n , /) 
be an n-dimensional Boolean system, and let S : M — > {0, l} n be a fixed 
discretization. Let Si denote the i-th component of S and let 

B = \J{bd(Sr\0}}. 

We will say that the trajectory of x = x(0) has the transversality property 
if there exists an increasing sequence of nonnegative reals, where < 
k < K < 00, such that 

(a) t = 0. 

(b) For all t G [to,ti) we have x(t) ^ B. In particular, S(x(t)) is constant 
for t G [io.ti). 

(c) For all k + 1 < K and all t G (ifc,ii) we have x(t) ^ B. In particular, 
the function S(x(t)) is constant for t G (tfc,tfc+i). 

(d) For all < k < K we have lim, ,- S{x{t)) ^ lim, ,+ S(x(t)). 

k k 

(e) If K = 00, then lim^oo tj. = 00. 

If x does have the transversality property, then the sequence = 
{tk(%)} that satisfies (a)-(e) above is uniquely defined. We call it the se- 
quence of switching times for x. Given this sequence we can associate with x 
a sequence of Boolean states 
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*V) = *(*(^)) « r + l< X , (ig) 

^( T ) = S(x(t K -i + t + 1)) if r + l>K. 

Recall the definition of Boolean dynamics ([2]). This be written in the 
form of n updating functions for the components fi of / = . . . , f n ) as 
follows: 



s i (T + l) = f i (s 1 {T),...,s n {r)). (20) 

A fixed point of a Boolean system B (or of /) is a state s = (s\, . . . , s n ) 
such that fi(s) = s, for all i G [n]. 

Definition 1 Let D, M, f be as above. 

(i) We say that the trajectory of x G M is strongly consistent with B if it 
has the transversality property and for all r 

**(t + 1) = /(**(t)). (21) 

(m,) PFe say that the trajectory of x G M is consistent with B if it has the 
transversality property and for all r 



V, ( S *( r + 1) = fi (g*(T)) v sf (r + 1) = S f (r)) 
^(t + 1) = s x (t) iff s x (t) is a fixed point o/B. 

(mj W^e say t/iat t/ie flow D is (strongly) consistent with M on U Q M if 
every trajectory that starts in U is (strongly) consistent with B. 

(iv) We say that the flow is (strongly) consistent with B if it is (strongly) 
consistent with B on an open set U C M that is universal in the sense that 
S maps U onto {0, l} n . 

Instead of the phrase "consistent with B" we will often write "consistent 
with /" for convenience. 

4 One-Stepping and Monotone- Stepping Boolean 
Systems 

Definition 2 Let B = ({0, l} n , /) be a Boolean system, and let s G {0, l} n . 
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(i) We say that the trajectory {s(r)}^ =0 of s = s(0) is one-stepping if 

Vr H(s(t),s{t + 1))<1. (23) 

(ii) We say that B is one-stepping if all its trajectories are one-stepping. 

Example 1 (i) Every Boolean trajectory that starts at a fixed point is one- 
stepping. 

(ii) Let I C [n] and define f : {0, l} n — >■ {0, l} n by letting /j(s) = Sj_i 2/ 
i ^ I and fi(s) = 1 — s«_i ifiGl, where the subscript i — 1 = geis treated 
as i — 1 = n. // |/| is odd, i/ten / defines a Boolean system B with exactly 
one one-stepping orbit that has length In. For a proof see J3J/ and pages 
79-81 oflLfl. 

Example 2 Let B = ({0, l} n , /) be any Boolean system. Define a Boolean 
system B° = ({0, l} n , f°) by letting /?(S) = f t (g) if fj(s) = Sj for all j with 
1 < j < i an d f°(s) = S{ otherwise. Then B° is one-stepping. 

Proposition 3 Suppose D is a flow on M and the trajectory of x G M 
is consistent with a Boolean function f for a given discretization. If the 
trajectory of S(x) under iterations of f is one-stepping, then the trajectory 
of x is strongly consistent with f. 



Proof: By the assumption of consistency, the trajectory of x has the 
transversality property and the corresponding sequence of Boolean states 



{s(r)}^ =0 = {s x (t)}^ =q satisfies (22). By assumption, the Boolean trajec- 



tory {/ r (s(0))}^ =0 has the property that f T (s(0)) differs from / r+1 (s(0)) in 
at most one coordinate, and it follows from (|22|) by induction over r that 



/ T (s(0)) = s(t), which in turn implies (21). □ 



While Proposition [3] indicates that one-stepping trajectories in Boolean 
approximations of differentiable flows are promising candidates for strong 
consistency, the next result shows that these are in a sense the only candi- 
dates for seeing strong consistency in a neighborhood. This is a well-known 
result, but not in this terminology, so we include a proof for completeness. 
First we need some terminology and a lemma. 



Definition 3 Let M be a compact m-dimensional topological manifold with 
boundary for some n, and let S : M —> {0, l} n be a discretization. For 
i £ [n] let Zi be the set of all x S M such that the i-th coordinate Si of S 
takes the value 0. We call S topologically nondegenerate if 
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(a) For all i G [n] both Z{ and M\Zi are m- dimensional topological mani- 
folds. 

(b) For all i E [n] the boundary bd(Zi) in M is a union of finitely many 
m — 1-dimensional topological manifolds. 

(c) For all i,j £ [n] with i ^ j the intersection bd(Zi) n bd(Zj) is a union of 
finitely many compact topological manifolds of dimensions < m — 2. 

(d) If x 6 bd(Zi) n bd(Zj) n int(M) and U is a neighborhood of x, then 
for every f : {i,j} — > {0,1} there exists a nonempty Vj C U such that 
SiilJ) = /(*) and Sj(y) = f(j) for all yeVf. 

For example, the discretizations for our flows 7), ID>2(/, 7) are topo- 
logically nondegenerate. In fact, whenever M a product of N compact 
nondegenerate intervals, with x = (a?i, . . . ,xn) and Si takes the value or 1 
depending on whether x% is below or above some threshold 0j the resulting 
discretization S will be topologically nondegenerate. 

Lemma 4 Let H) be a continuous flow and let M be a compact m- dimensional 
manifold that is forward-invariant for D. Let S : M — > {0, 1}" be a topo- 
logically nondegenerate discretization of M , and let the sets Z{ be as in 
Definition [3| Let i ^ j and suppose that x(0) is an initial condition and 
< t\ < tz are times with {x(t) : t £ [0, £3]} contained in the interior of M 
such that 

(i) x{t x ) € bd{Z i )r\bd{Z j ). 

(ii) For all y(0) in some neighborhood U of x(0) we have 

\{t e [o,t 3 ] : yit) e bd(Zi) n bd(Zj)}\ < 1. 

Then there exists a neighborhood W of x(0) and times to>^2 with < 
to < t\ < t2 < £3 such that the set 

NS(i,j) = MO) : yt G [t ,i 2 ] y(t) ^ n bd(Zj)} (24) 

contains a dense open subset V of W. 

Proof: Let W Q U be a sufficiently small closed neighborhood of x(to) such 
that for some times to < *i < ^1 trajectories that start in W don't leave M 
during the time interval [— 1% + ti,0]. Define a map F : W x [to, £2] - > 
M x [t ,t 2 ] by F(z(0),t) = (z(t - t ),t). Let if be the range of F. 

The function F is continuous in both variables. Since W x [to,t2] is 
compact, F is a homeomorphism between W x [to,t 2 ] and K. Thus if is a 
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topological manifold of dimension m + 1. By condition (c) of Definition [3j 
the set B = (bd(Zi) n bd(Zj)) x [to, £2] is a union of finitely many compact 
submanifolds of dimension < m — 1 of K. Consider the map G : B — > W 
that assigns to each (z, t) G B the unique y(0) G TV with = £ This 
map is continuous by continuity of the flow, and is injective by condition (ii). 
Thus G is a homeomorphism, and it follows that its range 

R = {y(0) G W : 3t G [t , i 2 ] y(t) G bd(Zi) D bd(Zj)} 

has dimension at most m — 1. In particular, V = W\R is dense and 
open in W, and the lemma follows. □ 

Corollary 5 Suppose O is a flow on a compact m- dimensional manifold M 
and B = ({0,1}™,/) is a Boolean approximation for a given topologically 
nondegenerate discretization S : M — > {0,1}™. Then strong consistency 
between D and IB on any open U C int(M) implies that for each x G U the 
trajectory of S(x) in M is one-stepping. 

Proof: Suppose we have strong consistency on U. Since strong consistency 
implies strong consistency on each subset of U, we may wlog assume that 
U is disjoint from the boundary of S' _1 ({0}) for all i £ [n]. Assume towards 
a contradiction that x G U is such that fi(s x (r)) ^ Si, fj{s x {r)) 7^ Sj for 
some t and i 7^ j. Assume wlog r = 0. Then we find ti > so that (i) of 
Lemma [4] holds. Moreover, by continuity and the transversality property, 
we can choose £3 in such a way that point (ii) of the lemma holds in some 
neighborhood of x; let us for simplicity assume that U itself has this property. 
But then for all y G NS(i,j) n U we must have either fi(s y (0)) = s\ or 
fj(s y (0)) = sj; otherwise strong consistency along the trajectory of y would 
be violated. Thus for all y G NS(i,j) n U we must have S(y) 7^ S(x). But 
since NS(i,j) contains a dense open subset of some neighborhood W of x 
by Lemma [4j we get a contradiction with point (d) of Definition [3| □ 

Definition 4 Let B = ({0, 1}™, /) and let s, s* G {0, 1}™. 

(i) We say that s* is strictly between s and f(s) and write s ■< s * ~< f(s) 
if s i = s t f or M i with Si = f{s)i and s* ^ f(s)- 

(ii) We say that the trajectory {s(t)}^° =0 of s = s(0) is monotone-stepping 
if the following holds: 

Vr Vs* (s(r) < s * -< s{t + 1) f(s*) = s{t + 1)). (25) 
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(Hi) We say that B is monotone-stepping if all its trajectories are monotone- 
stepping. 



Clearly, if H(s,f(s)) = 1, then the only s* with s ^ s * -< f(s) is s 
itself. Thus all one-stepping Boolean trajectories and Boolean systems are 
monotone-stepping, but not vice versa. 

Example 3 The function f : {0, l} 3 -»■ {0, l} 3 given by 

/(000) = 110 = /(010) = /(100); /(110) = 111; 
/(111) = 101; /(101) = 001; /(001) = 011; /(Oil) = 111 

defines a monotone-stepping Boolean system that is not one-stepping. 

5 Consistency and Strong Consistency: Some Ba- 
sic Examples 

In this section we include some examples that will illustrate the constructions 
and definitions given in previous sections and will put our main results into 
context. More details and additional examples can be found in |llj . 

5.1 Di(/, 7) for Boolean constants 

Let / : {0, 1} — > {0, 1} be a Boolean constant, that is, f(s) = or /(s) = 1. 
Since we are working in one dimension here, the ODE that defines 7) 
becomes 

± = 1 (g(x)+QQ(x)). (27) 
HQ takes only values in the interval [0, 1/6) (for f{s) = 0) or (5/6, 1] (for 



f(s) = 1), then (27) has only one globally asymptotically stable equilibrium 
that all trajectories will approach monotonically, and strong consistency on 
the whole state space follows. This will clearly be the case for the conversion 
scheme Qw> which returns a constant Q. 

Other conversion schemes may not be so well-behaved. For example, the 
Boolean expression (s A —>s) also represents the constant function f(s) = 0, 
but gets translated by Qr c , Q,Rd into Q that takes all values on the inter- 



val [0, 1/4]. These conversion methods return the following instance of (27): 



7 (g(x)+6L(x)(l-L(x))). (28) 
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Figure [T] shows the right-hand side for 7 = 1, and it can be seen that 
strong consistency will still hold. 



Figure 1: x = g(x) + 6L(x)(l — L(x)) 




However, more complicated Boolean expressions for a contradiction may 
cause problems. For example, consider / that is given by the Boolean ex- 
pression f(r) = a A -id, where a = s A s A s A s. This may be recursively 



converted into the following instance of (27): 



x = 1 {g(x) + 6L(x) 4 (l - L(x) 4 )). 



(29) 



Figure [2] shows the graph for 7 = 1. 

The system has three fixed points 77 = x~ , r2 = .58875, r% = .87703. We 
get strong consistency on [x~,r2) (which is a universal set), but not on the 
whole state space. 

In view of these potential problems one may wonder why we consider 
conversion methods other than Q\y at all. There are at least three reasons 



for this. As we already mentioned in Subsection 2.2 , speed of computing the 
conversion is one of them. Second, it seems a good idea to allow for more 
generality at little extra cost of the exposition, especially since some of our 
recursive conversion schemes are quite natural for simple updating functions. 
Third, suppose for example that fi = s\ A S3. Even Q\y will translate 
this into a composition of a quadratic polynomial with L. However, if we 
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Figure 2: x = g(x) + 6L(x) 4 (l — L{x) 
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investigate the behavior along a trajectory for which which S3 = 0, then /j 
will behave along this trajectory as a Boolean constant in exactly the same 
way as any contradiction, while Qi is not a constant. We want to build up 
a set of general tools that can be applied in such situations. 

5.2 Conversions of copy-negation 

There are two nonconstant Boolean functions / : {0, 1} — > {0, 1} of one 
variable: f(s) = s (the "copy" function), and f(s) = ->s ( "copy- negation" ) . 
For the latter function all Boolean trajectories satisfy 



. . . 1 — >- 1 — >- 1 1 — 1 — >- 1 1 — >- . . . 

In order to have consistency with this function we need some type of 
oscillations, which is not possible in a one-dimensional flow, at least if the 
discretization is based on a single threshold. In particular, we cannot have 
consistency along any trajectory of Di(/, 7, Q), for any choice of 7 and Q. 

Notice that the problem here is caused because / copies the negation of 
its variable to the variable itself, which is similar to the problem caused by 



self-regulation in Glass networks (see Subsection 7.1). Let us try to sidestep 



the problem by considering a two-dimensional system where the copying and 
negating steps are separated. 
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Let / = (fx, f 2 ) : {0, l} 2 -)> {0, l} 2 be defined by: 



/i(s) = -.s 2 fi{s) = si. 
This system has a single orbit given by 



(30) 



Define I 
This gives: 



00 ^ 10 ^ 11 ^ 01 (->• 00. (31) 
Di (/, (1, 1)) by any of the conversion schemes Q w , Qr c , Qm, Qrf- 



±i = g(xi) + 6(1 - L(x 2 )), 
X2 = g(x 2 ) + 6L(xi). 



(32) 



Since n = 2, we have the luxury of being able to perform an easy phase- 
plane analysis of D. Figure [3] gives the phase portrait. 



X1 ' = g[x1) + 6[1 -S(x2)> 




Figure 3: Nullclines and direction arrows for Di(/, (1, 1)). 

The two nullclines intersect at (0, 0), which is the only steady state. The 
eigenvalues of the Jacobian at the steady state have positive real parts, and 
the system has a unique limit cycle that will be approached by all trajectories 
that start off the origin. It can easily be seen by inspection of Figure [3] that 
the flow D is strongly consistent with / on the set U = [x~, x + ] 2 \{0, 0}. 
This will remain true even if we allow arbitrary vectors 7; only the shape 
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of the limit cycle and nullclines in Figure [3] will change for 71 7^ 72 , but not 
the qualitative behavior of the system. 

Recall that for one-dimensional flows we cannot get any consistency with 
copy-negation whatsoever. In a sense, we added just one dummy variable, 
and we got as much consistency with the Boolean dynamics as one could 
possibly hope for. Note that O is really nothing else but D2(/> (1, 1)) with the 
roles of variables reversed, and the consistency result obtained here carries 
over to 02(/; (lj 1)) for one-dimensional copy-negation /. This may exem- 
plify a more general tendency of intermediate variables to favor consistency. 
Our main result in Section [6] also points in the same direction. 

5.3 An example that is not monotone-stepping 

Define a Boolean updating function / : {0, l} 4 — > {0, l} 4 by 



/l(s) = -.s 2 f 2 ( s ) = Sl , 
/3O) = /4O) = s 3 . 



(33) 



This system is the direct product of the Boolean system defined by ( 30 ) 



of Subsection (5.2) with itself. There are four pairwise disjoint orbits of 



length four each in this system: 



0000 H- 1010 ^ 1111 ^ 0101 ^ 0000, 

0010^1011^1101^0100^0010, , 

34 

0011^1001^1100^0110^0011, 

0001 ^ 1000 ^ 1110 i-> 0111 ^ 0001, 

and it can be seen that the system is not monotone-stepping. Under several 
of our conversion schemes the flow Oi(/, 1) will be generated by the DEs 



x\ = ll(g(xi) + 6(1 - L{x 2 ))), 
±2 = 72(5(^2) + 6L(xi)), 
£3 = 73(5(2:3) + 6(1 - L(xi))), 
±4 = 74(5(2:4) + 6L(x 3 )), 



(35) 



with no interaction between the variables (xi,X2) and (0:3,2:4). Thus (35) 



can be treated as a direct product of two flows to which the results of 



Subsection 5.2 apply. 



20 



It is not hard to infer that all trajectories of (35) that start in the set 



U = [x , x ] \{x : x\ = X2 = V X3 = X4} 

are consistent with /, regardless of the choice of 7. Strong consistency on 
open sets in this example is precluded by Corollary [5] For generic choices 
of 7 the ODE dynamics on the attractor will become aperiodic (but not 
chaotic, only quasiperiodic) which precludes strong consistency with / for 
even a single trajectory of pBl). 



After changing the order of variables in (35 ) the system becomes D2(/> 7) 
for / : {0, l} 2 -> {0, l} 2 defined by 



/i(s) = -HSi / 2 (s) = ->s 2) (36) 

and analogous observations about consistency and strong consistency apply. 
The choice of the word "analogous" rather than "the same" in the preceding 
sentence was very deliberate, since when treating the same flow as D^OiT) 
rather than Di(-, 7), we are comparing its dynamics with a different Boolean 
system! 



Note that the function / defined by (36) has two disjoint periodic orbits 



00 ^ 11 H- 00, 



01 i-> 10 i-> 01, 



(37) 



and, similar to the function (33), is not monotone-stepping. 



6 Consistency for Monotone- Stepping Boolean Sys- 
tems 

In this section we will prove the following result. 

Theorem 6 Let f : {0, 1}™ — > {0, l} n be a Boolean function, let Q be a 
conversion scheme, and let 7" = (71, . . . ,j n ) be a fixed vector of positive 
reals. Then there exist /i > and nonempty open U s C W s for s £ {0, l} n 
such that for every extension of '7" to a 2n- dimensional vector^/ of positive 
reals with 7j +n < fi for all i £ [n] the following holds in D2(/>75 Q)-' 

(i) For every s£ {0, l} n whose trajectory inM = ({0,1}™,/) is monotone- 
stepping the flow D2(/>7) Q) is consistent with IB on U s . 

(ii) For every s £ {0, 1}™ whose trajectory in B = ({0, l} n , /) is one-stepping 
the flow D2(/)7) Q) is strongly consistent with B. 

(Hi) If IB = ({0,1}™,/) is monotone-stepping, then the flow 2 (f ', 7 ', Q) is 
consistent with B. 
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(iv) IfM = ({0, l} ra , /) is one-stepping, then the flow D2(/ 5 7, Q) is strongly 
consistent with B. 

Before proving the theorem, let us make some comments. By choosing 
/i sufficiently small relative to min7 _ we can assure that the values of the 
signaling variables Xj+„ change at a slower timescale than the values of the 
signature variables Xj. Thus Theorem [6] tells us that the relevant consistency 
results hold, with fixed witnesses U s or U = \J{U S : s G {0, l} n }, under 
sufficient separation of time scales. 

By our definitions, point (iii) of the theorem follows from point (i), and 
point (iv) follows from point (ii). Moreover, point (ii) follows from point (i) 
since by Proposition [3] for one-stepping trajectories strong consistency is the 
same as consistency. 

Proof of Theorem [6| It suffices to prove part (i). 

First let us introduce an additional parameter 5 in the definition of the 
sets W? of @: 



(38) 



Wf(5) = {x : Xi < -1 + 5} if Si = 0, 
Wf(5) = {x: Xi > 1 -5} if Si = 1. 

Let W s (5) = Hiefn] W[(5). Since the functions Qj are continuous, by 
there exists 5 > such that for all s and i £ [n] and all fixed x\, . . . , x n "~£ 



W s (5) the DE for Xj+ n in (10) has a globally attracting equilibrium. Let us 
fix a sufficiently small such 8 throughout this proof. 

Now there exist positive constants /?, a > that depend only on 5 such 
that for all i £ [n] and states x that satisfy either 

Xi G [-1 + 6,1] and x i+n > 2/3 - a (39) 



or 



we have 



€[-1,1-5] and x i+n < -2/3 + a (40) 



\xi\ > 7i/9. (41) 

To see this, first note that Xi +n > 2/3 — a iff L(xi +n ) > 5/6 — a/2 and 
Xi+n < — 2/3+a iff L(xi +n ) < l/Q+a/2. Choose a with < a < 5 such that 
the unstable equilibrium x° of x = g(x) + 5 + 3a satisfies x° < —1 + 5. Notice 
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that for this choice of a the unstable equilibrium x° of x = g(x) + 5 — 3a 
satisfies x° > 1 — 6, and hence Xi ^ on the compact set of all those x 
that satisfy (39) or (40). Now the existence of /3 follows from the Extreme 
Value Theorem. We will fix a, f3 as above for the remainder of this proof. 
For technical reasons we will assume a < 2/15. 

Now let us define analogues of the sets Wf(5) for the variables Xi +n . For 
e > let 



Vf(e) = {x: x t < -2/3 + e] if s t = 0, 
Vf(e) = {x : Xi > 2/3 -e} if Si = 1. 

In analogy with Wf, we will write V* instead of Vf(0). 
For each s G {0, 1}™ define the following sets 

A(s) = {i G [n] : fi(s) + Si }, T(s) = [n]\A(s). 

Let 

n - \A(s)\ 

a s = a. 

n 

Define R s C M as the open set of all states in the set 

pr s = n wi-(«j)x n w, s x pi v^ as ) 

ieA(s) ier(s) «er(s) 

that satisfy the following condition for all i E [n]: 

f£l^ s (W implies xeV/ (s \a s ). (43) 

Let 

ier(s) 

Then C/ s is nonempty, open, and S'(x) = s for every x G {7 s . 
For a given state x G M, a given s G {0, l} n , and j G [2n] consider the 
DE for xj in (10). Let x*(x, s) denote the locally stable equilibrium that is 



< -1 if sj = or Sj— n — and this equilibrium exists, or the locally stable 
equilibrium that is > 1 if sj = 1 or Sj- n = 1 and this equilibrium exists. 
Similarly, let x°(x, s) denote the unstable equilibrium in (—1, 1) if it exists. 
In our arguments, we will omit the parameters x, s if they are implied by 
the context. 
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Equipped with this terminology, let us consider as a warm-up what hap- 
pens to an ODE trajectory that starts in U s when s is a fixed point of /. 
Then A(s) = and T(s) = [n]. In this case the equilibria x° do not exist, 
and x* will be globally attracting in the dynamics of X{ for all i £ [n]. Thus 
the trajectory will never leave W s , which implies that the variables Xj+ n will 
keep moving away monotonically from the interval [—2/3,2/3]. It follows 
that U s is forward invariant in this case; in particular, no change in the 
Boolean state will occur at any future time, and we get strong consistency 
on U s with the Boolean trajectory of s. 

If s is not a fixed point of /, things become more complicated. Let 
us call a Boolean state s monotone for f if /(s) = f(s') for all s' with 
s ■< s' ~< f(s). Clearly, a monotone-stepping trajectory is one that visits 
only monotone states. In view of what we have already shown for fixed 
points, if suffices to prove that there exist fj, > and T m j n > such that 
for every extension of 7 ~ to a 2ra-dimensional vector 7 of positive reals with 
7i +n < \i for all % G [n] and every s that is monotone but not a fixed point 
of / and every x(0) G U s the following conditions hold: 

(A) x(T) G U^ s \ 

(B) Xi(t) / for every i G T{s) and all t G [0, T], 

(C) For every i G A(s) there exists exactly one t G [0, T] with Xi(t) = 0. 
Let us first make a couple of remarks. 

The requirement that the times T are bounded away from by a fixed 
T m i n is needed to ensure condition (e) of the transversality property. But 
the existence of such T m j n will follow automatically from (A), because as s 
is assumed not to be a fixed point, at least one of the x^s has to traverse the 



entire interval [—1, 1] between times and T, and since < 5ji (see (45) 
below), this will take at least ^ time units. Taking 7, = max 7" here gives 
a required T min . 

Since there are only finitely many Boolean states to consider, we can 
simplify our task by determining a suitable \x = \x(s) for each relevant s 
separately and then taking /i as the minimum. Thus for the remainder of 
the proof we will fix s that is monotone and assume that x(0) G U s . 

We will argue that under sufficient separation of time scales there exists 
T such that (A)-(C) are satisfied and the trajectory of x(0) on the time 
interval [0, T] can be partitioned into three types of episodes. 

For all times i in a Type I episode we will have x G R s for some s' 
with s ^ s' ~< f(s). Notice that such s' must be monotone and must satisfy 
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f(s') = f( s ), A(s') C A(s) and T(s') 5 r(s). Clearly, time t = belongs to 
a Type I episode with s' = s. 

During a Type I episode, all X{ for i E T(s') move towards the equilibrium 
x* which is globally stable in this case. Similarly, by the choice of S, each 
variable Xi +n for i E r(s') will move towards the unique globally stable 
equilibrium x* +n . In particular, throughout a Type 1 episode, the system 
will stay within the set 

f) wfn (~) vf(a s ,)c f] w°n fl t?(a,). 

ier(s') iev(s') iev(s) ier(s) 

In contrast, each variable Xj+ n for i E T(s') will move away towards the 

f(s') f(s) 

unique globally stable equilibrium in V/ = V i . This movement will 
continue until either the variable enters V/^ s \ or some x\ for i E A(s') C 
A(s) enters the interval [— 1 + 5, 1 — 5], that is, x leaves W* (5). In the former 



case, x *(/(s)) becomes the globally stable equilibrium of the DE (TXOJ) for Xi, 
and Xi starts moving towards the boundary of [— 1+5, 1 — 5]. This movement 
can be arrested only if Xj+ n changes direction, which in turn requires some 
variable xy to enter the interval [— 1 + 5, 1 — 5] . The upshot is that a Type I 
episode ends at a time t{ when Xi(t s i) E {—1 + 5,1 — 5} for at least one 
variable xi with i E A(s') C A(s). 

The last condition marks the onset of a Type II episode for i. We can 
see from the above discussion that Type II episodes for different i E A(s) 
may overlap or even occur simultaneously, but we will see that only one such 
episode for each i E A(s) can occur in the interval [0,T]. 

We want to show that under sufficient separation of time scales, during 
a Type II episode for i, the variable x\ will move monotonically from —1 + 5 
into the interval (l,x + ] or from 1 — 5 into the interval [x~ ,— 1) while not 
much movement of variables Xj+ n occurs. For ease of exposition, consider 
the onset of a Type II episode for i at time U with Xi(U) = —1 + 5; the case 



Xi(ti) = 1 — 5 is symmetric. By (41 ), the variable X{ will keep monotonically 



increasing and will reach the interval (1, x + ] at some time Tj > U with 

T,-t,<+ (44) 

unless Xi +n {t) < 2/3 — a for some time t > ij with t — ti < ^-g- 

Note that since Qi is assumed to take values only in the interval [0, 1], 
the shape of g implies that we have at all times t and for all j E [2n] 

\ Xj (t)\ < 5 7i . (45) 
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Now consider t{ that marks the onset of the first of k overlapping Type II 
episodes for % G I C A(s'). Then we must have k < |A(s')| < |A(s)|, and 
the combined length of these Type II episodes is at most fcmin7 _ . Let 

8 min 7 ~ a , , . 

< fJL < ^—^ , 46 

on 

and assume Jj+ n < A* for all j G [n] . 



Condition ( 43 ) applies to alH G / at time to > and for each such i we must 
have x(t) G ( Q s') a t some time i in these overlapping Type II episodes. 
But by ( 45 ) , for each i £ I it will take more than g g _ time units to 



travel a distance of more than ^ units. This shows that all Xi for i G I will 
reach their destinations in [x~ , — 1) U (1, x + ] before the system has a chance 
to move out of C\ ie iVf (a). Similar considerations apply to the variables 
Xj +n for j G r(s'): while we don't have not much control over Q during a 
Type II episode and these variables may move briefly in the wrong direction, 
they cannot get very far; each of them will move by less than — units. 

Let us make the observation more precise in the following way: Consider 
Type II episodes as above and let s" be such that s" = s[ for all i G [n]\I 
and s'l = 1 - aj for all i G /. Then s' ~< s" < f(s). If s" + f{s), then 
s" is monotone and A(s") = A(s')\J, T(s") = r(s') U /. In this case, after 
completion of these Type II episodes, the system will have entered a state 
in R s , and the next Type I episode starts. 

This alternation of Type I and Type II episodes will continue until all 
variables Xj with i G A(s) have crossed the interval [—1,1], exactly once, 
assuming the value at exactly one time along the way, which implies (C). 
Moreover, all variables x% with % G r(s) will stay in [x~ , —1) U (1, x + ], which 
implies (B). Eventually, after completing the last Type II episode, the system 
will reach a state x{T~) G n W s " where s" = /(s). 

Such time Tj will mark the onset of a Type III episode. We need only 
to show that under sufficient separation of time scales during a Type III 
episode the trajectory will move from R^ s ^ into U^ s ^ while staying inside 
Wf( s \ This will imply (A) without violating (B) or (C) and complete the 
proof of the theorem. 

We will not need to assume that f(s) is monotone, but we still need 
to consider the set and show that at some time T > T~ we have 

x(T) G rk e r(/( s )) V / (S) while 2(f) e wf{s) for a11 1 G t T ~> T ]- Notice that 
at time T~ for each i G [n] the variables Xi,Xi+ n will be on the same side 
of and head in the direction of the locally stable equilibria x* and x* +n . 
If x,i +Tl (T~) G [—2/3, 2/3] then Xi +n must have entered this interval during 
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a Type II episode (after leaving it and releasing Xi if i € A(s)), and can 
have subsequently moved deeper into this interval only during some of the 
Type II episodes when we didn't have control over Q. Thus by (45) the 
distance of Xi+ n from the nearest endpoint of this interval can be at most 
b^i +n K, where K denotes the combined duration of all Type II episodes 
since time t = 0. By (44), we can estimate 
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K < R . ^ ■ (47) 
On the other hand, while x{t) G W^ s \ by (|5j) and the shape of g we 



have 



Ji+n < |a=i+fi(*)|- 



(48) 



Let T = T~ + 



P min 7 " 



Now (47) and (48) imply that the trajectory of 



x(T ) will reach at or before time T as long as it stays inside ly^W 

during the time interval [T~,T]. But the trajectory can leave W^ s "> only 



after some x 



a, 2/3 



-2a 



has crossed over to the other side of the interval 
a], which in view of (45) takes at least — 

4/3 



2/3 + 

time units. Since we 



assumed that a < 2/15, we have a < 



-2a 



57j + n 

and it follows from the choice 



of /i in (46) that x(t) will stay inside W^ s ^ during the time interval [T ,T] 



as long as ji+ n < /i for all i € [n]. □ 

Let us remark that we may see consistency even in systems that are 
not monotone-stepping; Subsection 5.3 gives an example. In this example, 
the flow ©2(7, 7) is a direct product of two flows with one-stepping Boolean 
approximations whose variables don't interact. Theorem [6] clearly applies to 
to each factor and thus generalizes to direct products of monotone-stepping 
systems. It remains an open problem to find the most general assumptions 
under which the conclusion of Theorem [6] holds. 



7 Discussion 
7.1 Related results 

The literature contains a few results on consistency between differentiable 
flows and Boolean systems; here we discuss how these are related to our The- 
orem |6j The best-known examples are the results for Glass networks. These 
models were developed by Glass in [5]-[8] based on earlier work on similar 
models by Glass and Kauffman |9j . The paper [2] gives a review of the major 
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results and a unifying approach to the extensive literature on these networks. 
For suitable choices of the functions and decay constants A, in ([3]), the 
resulting flows are consistent with their Boolean approximations. Consis- 
tency becomes problematic though in the presence of self-regulation, that is, 
if Fi depends on Xj. As our work in Subsection 5.2 shows, similar problems 
may occur in our systems 7). While the results about consistency in 

Glass networks do not require an assumption of monotone-stepping trajec- 
tories, Corollary [5] applies and strong consistency does require one-stepping 
Boolean trajectories. 

In contrast, Terman et al. [17 \ constructed a class of excitatory-inhibitory 
neuronal networks whose ODE models have natural Boolean approximations 
and showed that every Boolean system can be translated into a model in 
this class so that we have a form of strong consistency. This does not con- 
tradict Corollary [5] because the notion of consistency in |17j is different from 
Definition [T] and seems more appropriate for the dynamics of these networks. 
Essentially, switches of the Boolean states of several variables are treated 
as simultaneous if they occur within a small time-windows that mark the 
boundaries between so-called episodes. This opens a promising avenue of 
future research on generalizations of this notion of consistency as well as 
possible generalizations of Theorem [6] in this direction. 

Gehrmann and Drossel [1] obtained results about consistency between 
ODE models for two small gene regulatory networks and their Boolean ap- 
proximations. In contrast to Glass networks and [17J, in these models the 
right-hand sides of the ODEs are Lipschitz-continuous, as they are in the 
models studied here. 

The systems of [HE] and our systems B>2(f, 7) can all be conceptualized 
as networks of interacting agents, where the ODE variables are grouped into 
pairwise disjoint sets Xj that constitute the i-th agent and only one Boolean 
variable is assigned to each agent. Roughly speaking, in |17j an agent corre- 
sponds to a neuron whose state is characterized by a cross-membrane voltage 
and a so-called gating variable, in [1] an agent corresponds to a gene whose 
state is characterized by its mRNA concentration and the concentration of 
the corresponding gene product, and in ID>2(/j7) we have Xi = {xi, Xi +n }. 
Such a partition into agents appears natural in many models of real-world 
systems and may favor consistency between an ODE system and its Boolean 
approximation. For example, in our systems O2 (y, 7) self-regulation does not 
cause the kind of problems for consistency as it may cause in systems Di (/, 7) 
or Glass networks, where all variables are discretized. Identifying and per- 
haps classifying general mechanisms in such networks of interacting agents 
that favor or guarantee some form of consistency is another promising avenue 
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for further research. 

In particular, we are planning to generalize Theorem [6] to much larger 
classes of networks of interacting agents. The mechanism that gives Theo- 
rem [6] of course is sufficient separation of timescales in addition to suitable 
bifurcations in the internal dynamics of the signature variables, and the 
theorem should generalize in this form. The consistency result in |17| also 
relies on separation of time scales, with voltages changing much faster than 
gating variables, but an additional synchronization mechanism is built into 
the network architecture. In contrast to Theorem [6j very large separation 
of time scales destroys the consistency for the first system studied in [3], 
despite the fact that its Boolean approximation is one-stepping. Thus the 
mechanism for consistency at other time scales that is reported in [3] must 
be different. 

There are some similarities between the proof of our Theorem [6] and 
the results in |10| about certain models of gene regulatory networks with 
steep sigmoid functions. In particular, we want to note that in our systems 
ID>2 (/, 7) each signaling variable regulates exactly one signature variable has 
a parallel in Assumption A of [10] that every transcription factor regulates 
exactly one gene at each of its thresholds. It appears, however, that prov- 
ing analytical results about gene regulation with steep continuous sigmoid 
function is in general more challenging than proving analogous results for 
the classes described here (see [TU] and references therein for description of 
some difficulties in the former classes). 

Many Boolean systems that have been studied in the literature are one- 
stepping. The one-input systems considered in [9j are a special case, we 
mentioned already [4], and the Boolean approximation of the models con- 
sidered in |15j are another example. The latter paper compares various 
approximations, not only Boolean ones, to a complete nonlinear model of 
gene regulation and reports that substantial discrepancies can arise between 
the predictions of various models for even such a simple system. This is 
another piece of evidence that our models are better behaved than would 
be expected of models of gene regulation. 

7.2 Chaos 

Chaos in differentiable flows has been widely studied. A notion of chaos in 
classes of Boolean systems has been proposed by S. Kauffman and has been 
fairly extensively studied (see [TJ [T2] for reviews) . It is a natural question 
whether there is any connection between these two notions of chaos in the 
sense that differentiable flows that can be translated into a chaotic Boolean 
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system must be or will tend to be chaotic flows, or vice versa. In other words, 
it is natural to ask whether the two notions of chaos are saying something 
equivalent about the underlying natural system or whether they are just two 
different mathematical properties that happen to share a name. 

Chaos in individual Boolean systems can be defined in terms of the slope 
of the Derrida curve at the origin, that is, the average Hamming distance 
after one updating step for randomly chosen initial states with Hamming 
distance 1. If this slope exceeds 1, the system can be considered chaotic. It 
is easy to see that there cannot be a straightforward correspondence between 
chaos in flows and chaos in this sense in their Boolean approximations. For 
example, the two-dimensional system with / given by 



/(oo) = 00, Z(oi) = n, /(io) = oi, /(ii) = io 

is chaotic in this sense, but the corresponding two-dimensional flow Di(/, 7) 
cannot exhibit chaos. 

It seems quite likely though that there are some more subtle connections 
between the two notions of chaos or between chaos and consistency. Explor- 
ing such connections leads to interesting and quite challenging questions. 
For example, it would be interesting to know under what conditions the 
sets U s of Theorem |6^ii) must intersect a unique (attracting) periodic orbit, 
which would preclude chaos in this region of the state space. This remains 
an open question even for the one-stepping trajectories of Example [T](ii) and 



the conversion schemes that we presented in Subsection 2.2 Our software 



has a module for estimating Lyapunov exponents and allows for numerical 
explorations of such problems. 



7.3 Conclusions 

We constructed, for every Boolean system with updating function /, two 
classes of ODE systems 7, Q), O2 (/, 7, Q) for which the Boolean system 
B = (2 n ,/) is a natural approximation. Theorem [6] shows that sufficiently 
large separation of time scales guarantees consistency between D2(/>7> Q) 
and B = (2 n , /) on a large region of the state space of the former, as long 
as / is monotone-stepping. Classes of ODE systems that were previously 
investigated in the literature for consistency with their natural Boolean ap- 
proximations either have discontinuities in their right-hand sides or tend 
to not satisfy the counterpart of Theorem [6] in its most general form. In 
our opinion, this makes the models presented here a promising class of toy 
models for elucidating general mechanisms that favor or entail consistency 
between an ODE system and its Boolean approximation. It seems likely that 
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the insights from studying such mechanisms in the context of our models 
would, at least to some extent, carry over to classes of realistic but analyti- 
cally less tractable models of natural, in particular biological, phenomena. 
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